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Abstract. Bodmann, Casazza and Kutyniok introduced a quantitative notion of redun- 
dancy for finite frames - which they called upper and lower redundancies - that match better 
with an intuitive understanding of redundancy for finite frames in a Hilbert space. The 
objective of this paper is to see how much of this theory generalizes to infinite frames. 



1. Introduction 

The customary notion of redundancy for a finite frame {<pi]f =l in T-L n is to use — . Many 
people have felt for a long time that this was not really satisfactory since it assigns redundancy 
2 to each of the following frames (where {ej}™ =1 is an orthonormal basis for "H n ): 

$1 = {ei,ei,e 2 ,e 2 , . . . ,e n ,e n }; 
$2 = {ei, . . . , ei, e 2 , e 3 , . . . , e n }, where e\ occurs (n + l)-times, 
$ 3 = {ei,0,e 2 ,0,...,e n ,0}. 

The frame $i has redundancy 2 and is a disjoint union of two spanning sets and a disjoint 
union of two linearly independent sets. This description of redundancy is informative. But 
for $ 2 , the frame is heavily concentrated in one dimension of the space. In particular, this 
frame is made up of just one spanning set and it requires (n+l)-linearly independent sets to 
represent it. Finally, the frame $3 is made up of one orthonormal basis and a collection of 
zero vectors. Assigning this frame redundancy 2 is quite misleading. Although zero vectors 
are important in some areas of frame theory, such as filter bank theory, counting them in 
redundancy gives no useful information. What is important, is to keep track of the number 
of zero vectors while not letting them artificially increase redundancy. 

In this paper, we generalize the results of [9] by applying their quantitative notion of 
redundancy for finite frames in a Hilbert space H, to infinite frames. Most of the results 
carry over easily, but a few fail in this setting . 

Concerning infinite-dimensional Hilbert spaces, much work has been done on the idea of 
deficits, excesses and redundancy [21 [T], [3j HI 0, IS] - in [7], the authors provide a meaningful 
quantitative notion of redundancy which applies to general infinite frames. In their work, 
redundancy is defined as the reciprocal of a so-called frame measure function, which is a 
function of certain averages of inner products of frame elements with their corresponding 
dual frame elements. More recently, in j6] , it is shown that ^-localized frames satisfy several 
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properties intuitively linked to redundancy such as that any frame with redundancy greater 
than one should contain in it a frame with redundancy arbitrarily close to one, the redun- 
dancy of any frame for the whole space should be greater than or equal to one, and that 
the redundancy of a Riesz basis should be exactly one, were proven for this notion. Our 
approach is slightly different in that we are interested in how many spanning sets or linearly 
independent sets are in the frame. However, our notion does not capture much information 
about infinite frames whose frame vectors are not bounded. We will give examples to show 
the problems with our notion of redundancy for unbounded frames. 

1.1. Review of Frames. We start by fixing our terminology while briefly reviewing the 
basic definitions related to frames. Let % denote an n-dimensional real or complex Hilbert 
space and % denotes a finite or infinite dimensional Hilbert space. A frame for a Hilbert 
space H is a family of vectors {0j}j e / (with |/| finite or infinite) for which there exists 
constants < A < B < oo such that 

A\\x\\ 2 < ^ |(x,^)| 2 < B\\x\\ 2 for all xeU. 

When A is chosen as the largest possible value and B as the smallest for these inequalities to 
hold, then we call them the (optimal) frame constants. If A and B can be chosen as A = B, 
then the frame is called A-tight, and if A — B — 1 is possible, $ is a Parseval frame. A 
frame is called equal-norm, if there exists some c > such that = c for all i = 1, . . . , N, 
and it is unit-norm if c = 1. 

Apart from providing redundant expansions, frames can also serve as an analysis tool. In 
fact, they allow the analysis of data by studying the associated frame coefficients ((x, <fi))iei, 
where the operator T$ defined by T$ : H — > hi), % H- ((x,<pi))i e i is called the analysis 
operator. The adjoint T| of the analysis operator is typically referred to as the synthesis 
operator and satisfies T|((ci)i e /) = J^iei^fi- The main operator associated with a frame, 
which provides a stable reconstruction process, is the frame operator 

i&I 

a positive, self-adjoint invertible operator on "H. In the case of a Parseval frame, we have 
= Id%. In general, S$ allows reconstruction of a signal x G "H through the reconstruction 
formula 

x = ^2(x,S^ 1 (p i }(f i . (1) 

The sequence (S^fi)^ which can be shown to form a frame itself, is often referred to as 
the canonical dual frame. 

We note that the choice of coefficients in the expansion ([T]) is generally not the only possible 
one. If the frame is linearly dependent - which is typical in applications - then there exist 
infinitely many choices of coefficients (ci)f =1 leading to expansions of x e ~H by 



x = y^Qy?j. 



(2) 
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This fact, for instance, ensures resilience to erasures and noise. The particular choice of 
coefficients displayed in ([T]) is the smallest in £ 2 norm [2D], hence contains the least energy. 
A different paradigm has recently received rapidly increasing attention [TT] , namely to choose 
the coefficient sequence to be sparse in the sense of having only few non-zero entries, thereby 
allowing data compression while preserving perfect recoverability. 

For a more extensive introduction to frame theory, we refer the interested reader to the 
books [21], [29j [20] as well as to the survey papers [26j EZ] • 

1.2. An Intuition-Driven Approach to Redundancy. In order to properly define a 
quantitative notion of redundancy, the authors of [9J first gave a list of desiderata that a 
notion is required to satisfy. 

1.3. Desiderata. Summarizing and analyzing the requirements we have discussed, we state 
the following list of desired properties for an upper redundancy TZ§ and a lower redundancy 
7Z$ of a frame $ = (tpiji^i for a finite or infinite dimensional real or complex Hilbert space 
H. 

[Dl] Zero Vectors. Redundancy should not count zero vectors. 

[D2] Generalization. If $ is an equal-norm Parseval frame, then in this special case the 
customary notion of redundancy shall be attained, i.e., 7Z J = TZ§. 

[D3] Nyquist Property. The condition 1Z§ = 1Z\ shall characterize tightness of a normal- 
ized version of thereby supporting the intuition that upper and lower redundancy 
being different implies 'non-uniformity' of the frame. In particular, IZ^, = 1Z\ = 1 
shall be equivalent to orthogonality as the 'limit-case'. 

[D4] Upper and Lower Redundancy. Upper and lower redundancy shall be 'naturally' 
related by < 1Z J < 1Z J < oo. 

[D5] Additivity. Upper and lower redundancy shall be subadditive and superadditive, 
respectively, with respect to unions of frames. They shall be additive provided that 
the redundancy is uniform, i.e., 1Z^ = 1Z%. 

[D6] Invariance. Redundancy shall be invariant under the action of a unitary operator on 
the frame vectors, under scaling of single frame vectors, as well as under permutation, 
since intuitively all these actions should have no effect on, for instance, robustness 
against erasures, which is one property redundancy shall intuitively measure. 

[D7] Spanning Sets. The lower redundancy shall measure the maximal number of spanning 
sets of which the frame consists. This immediately implies that the lower redundancy 
is a measure for robustness of the frame against erasures in the sense that any set of 
a particular number of vectors can be deleted yet leave a frame. 

[D8] Linearly Independent Sets. The upper redundancy shall measure the minimal number 
of linearly independent sets of which the frame consists. 

It is straightforward to verify that for the special type of frames consisting of orthonormal 
basis vectors, each repeated a certain number of times, the upper and lower redundancies 
given by the maximal or minimal number of repetitions satisfy these conditions. The chal- 
lenge is now to extend this definition to all frames in such a way that as many of these 
properties as possible are preserved. 
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2. Defining Redundancy 

2.1. Definitions. As explained before, we first introduce a local redundancy given in [9], 
which encodes the concentration of frame vectors around one point. Since the norms of 
the frame vectors do not matter for concentration, we normalize the given frame and also 
consider only points on the unit sphere § = {x G H : = 1} in H. Hence another way to 
view local redundancy is by considering it as some sort of density function on the sphere. A 
consequence of normalizing the frame vectors, is that our new set may no longer be Bessel. 

We now define a notion of local redundancy. For this, we remark that throughout the 
paper, we let (y) denote the span of some y G H and P( y ) the orthogonal projection onto 

(y>- 

Definition 2.1. Let <3> = (<£>i)ier be a frame for 1-1 . For each x G S, the redundancy function 
!Zq> : § — > M + is defined by 

n^x) = J2\\P(^)\\ 2 - 

We might think about the function 1Z<$> as a redundancy pattern on the sphere, which 
measures redundancy at each single point. Also notice that this notion is reminiscent of the 
fusion frame condition [13], here for rank-one projections. 

In contrast to [9], this redundancy function may not assume its maximum or minimum on 
the unit sphere and in general both the max and min of this function could be infinite. 

We now define: 

Definition 2.2. Let $ = (<^j) ie j be a frame for H. Then the upper redundancy of $ is 
defined by 

1Z% = sup 1Z<s>(x) 



x& 



and the lower redundancy of $ by 



71$ = inf lZ$,(x). 



Moreover, $ has a uniform redundancy, if 

7^-<j> = l^-q>- 

This notion of redundancy hence equals the upper and lower frame bound of the normalized 
version of the frame - which could now be infinite. 

3. The Case of Infinite Redundancy 

3.1. Main Result. With the previously defined quantitative notion of upper and lower 
redundancy, we can now verify the properties from Subsection 11.31 which hold (and those 
which do not hold) in the infinite dimensional setting. 

Theorem 3.1. Let $ = (y?i)ig/ be a frame for an oo- dimensional real or complex Hilbert 
space H and assume that 1Z + < oo. 

[Dl] Generalization. If $ is an equal-norm Parseval frame, then 

7^ = K%. 
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[D2] Nyquist Property. The following conditions are equivalent: 

(i) We have IZ'g = 11%. 

(ii) The normalized version of $ is tight. 
Also the following conditions are equivalent. 
(i') We have K$ = K% = 1. 

(ii') $ is orthogonal. 
[D3] Upper and Lower Redundancy. We have 

< K$ < K% < oo. 

[D4] Additivity. For each orthonormal basis (ej)™ =1; 

V ± — 7? ± -I- 1 

Moreover, for each frame $' in 

^-c^u*' — ~^ owe? 7?-$u$/ ^ 72-$ + ■ 

In particular, if $ and oaf e uniform redundancy, then 

^<J>U<I>' = 72-$' = ^iuS' - 

[D5] Invariance. Redundancy is invariant under application of a unitary operator U on 



V,, i.e., 



V ± — 



under scaling of the frame vectors, i.e., 



^7/> \ N — "^<t> ' scalars, 
and under permutations, i.e., 

[D6] Spanning Sets. In the finite setting, $ contains \JZ$\ disjoint spanning sets. In the 

infinite dimensional setting, this property fails as we will show with an example. 
[D7] Linearly Independent Sets. <3> can be partitioned into [72.^] linearly independent sets. 

Proof. The properties [Dl] is true because redundancy is the upper and lower frame bounds 
of the normalized version of the frame. 

The first part of [D2] is true by definition and for the second part of [D3], it is well known 
that a unit norm Parseval frame must be an orthonormal basis. 

Property [D4] follows easily from the argument in [9]. 

Property [D5] is ovbious. 

Property [D6] fails as we will see in the next section. 

[D7] follows from Theorem 4.2 of [12] which states that: Every Bessel sequence {<Pi}i£i 
with Bessel bound B and \\fi\\ > c for all % e / (in our case c = 1), can be decomposed into 
\B/c 2 ~\ linearly independent sets. □ 

The redundancy function gives little information near the extreme cases - as was true in 
the finite dimensional the following example shows. 
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Example 3.2. We add a example in which the frame is not merely composed of vectors 
from the unit basis {ei, . . . , e n }. Letting < e < 1, we choose $ 4 = (<fi)iei as 

{ex : i = 1, 
\/l - £ 2 ei + eei : z ^ 1 
ei : i > N. 

This frame is strongly concentrated around the vector ex- We first observe that 

N N 

rc*s(ei) = E II^W e i)H 2 = 1 + l(ei, vT^e! + ee,)| 2 = 1 + (N- 1)(1 - £ 2 ). 

i=l i=2 

However, this is not the maximum, which is in fact attained at the average point of the 
frame vectors. But in order to avoid clouding the intuition by technical details, we omit this 
analysis, and observe that 

i + (iv-i)(i-e 2 ) <ni 4 <n. 

Since 

N N 

K*M = E II^W^H 2 = E ^^ex + e ei )\ 2 = e\ 

i=X i=2 

we can conclude similarly, that 

< < e 2 . 

The frame $3 shows that the new redundancy notion gives little information near the 
extreme cases: Tlr w and 1Z + large, but becomes increasingly more accurate as 1Z~ and 
1Z + become closer to one another. By [D2], the frame $4 is not orthogonal, nor is it tight. 
[D6] is not applicable for this frame, since L^-jJ = although there does exist a partition 
into one spanning set. Now, [D7] implies that this frame can be partitioned into N — 1 
linearly independent sets. Again, we see that we can do better than this by merely taking 
the whole frame which happens to be linearly independent. As before, we observe that [D7] 
is not sharp for large values of 1Z + . However, these become increasingly accurate as 1Z~ and 
1Z + approach each other. 



4. Infinite Equal Norm Parseval Frames 

It is easy to construct infinite equal norm Parseval frames for which the norms of the 
vectors are aribitrarily close to one. 

Theorem 4.1. For any r < 1, there is an equal norm Parseval frame {tfi}^ for £2 with 
WViW 2 = r ! f or all i = 1,2, .. .. 

Proof. Given the orthonormal basis {e 27Tmt } n£ z, let E C [0, 1] be a measurable set for which 
l^l = r. Then 

/ 2-Kvnt X 

is a Parseval frame of norm r vectors. □ 
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5. Infinite Parseval Frames 

Since linear independence is so weak in the infinite dimensional setting, we will now see 
that (equal norm Parseval) frames can have some surprising properties. This will affect our 
work in this area. 

Example 5.1. For every natural number k G N there is an equal norm Parseval frame 
for £ 2 which can be written as j -linearly independent and disjoint spanning sets, for all 
j = l,2,...,k. 

Proof. It is straightforward to choose families of vectors {fij}fj = i satisfying: 

(1) The vectors {fij}ij=i are linearly independent. 

(2) For each j — 1, 2, . . ., we have that span {fij}^ is dense in £ 2 . 

It follows that if we apply Grahm-Schmidt to {fij}°^ 1 for each j = 1,2,..., we get a 
sequence of orthonormal basis {gij}^ for £ 2 , with the property that {gij}ij=i is a linearly 
independent set. Fix fceN and consider the family: 

00, k 



1 



fij 



i=l,j=X 



This family clearly has the desired properties. □ 

Example 5.2. There is a Parseval frame for £ 2 which can be written as j-linearly inde- 
pendent and disjoint spanning sets, for all j = 1, 2, . . . , 00. (Note that j = 00 is included 
here). 

Proof. We use the family {<7i?}f} = i from Example 15. II and form the Parseval frame 

' 1 

This is the required family. □ 
6. More on the Infinite Version of Property [D6] 

In this section we will further examine property [D6]. Unfortunately, it is dangerously 
close to Kadison-Singer. First, we give an alternative proof of Corollary 2.4 of [TU] . 

Definition 6.1. A family of vectors {(pi} c *l 1 is w-independent if whenever 

00 

)]ai(pi = 0, 

i=l 

it follows that at = 0, for all i = 1, 2, . . .. If we have this property only for all {ctj}^ G £ 2 , 
we say the family of vectors is ^-independent. 

Theorem 6.2. Let {Pei} c *l 1 be a Parseval frame inT-L. If I C N, the following are equivalent: 

1. The family {Pei}^ spans PiH). 

2. The family {(I — P)ej}j £ /c is £ 2 -independent. 
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Proof. (1) (2): Assume that {(J — P)ej}j e / C is not ^-independent. Then there exists 
scalars {bi} ie jc e £ 2 so that 

J2bi(i - P)a = o. 

It follows that 

f = ^b i e i = ^b i Pe i eP(M). 

Thus, 

(/, Pej) = (Pf, ej) = M^, e i) = °> if 3 ^ L Le - if •? G J - 
So / _L span {Pej}j £ /, and this family is not spanning for P{Ji)- 

(2) =>■ (1): First assume there is an / G P(H) so that / _L span {Pej}j e /. Then, / = 
^2 ieI aiPei. Also, 

(/, Pe % ) = (Pf, et) = (f, <*) = 0, for all i E I. 
Hence, / = Yliei c b^ti, with not all 6, = and {bi} ie ic e Thus, 

Y^he l = f = Pf = Y,hP^- 

iei c iei c 

i.e. 

Y,bi(I - P)ei = 0. 

That is, (/ — P)ei}.; e / C is not ^-independent. □ 

Corollary 6.3. The property [D6] is true for unit norm 2-tight frames if and only if whenever 
{ l ~Pi\°^i is a unit norm 2-tight frame then there is a partition {Ji,^} of N so that {y^}^ 
is ii-in&epen&ent for j = 1,2. 

If we examine the proof above, we see that what is proved is really the following: 

Corollary 6.4. Let {ej}j e / be an orthonormal basis for % and {Pej}j e / be a Parseval frame 
forP{U). If 

ip G span {ei} ie j n P{H), 

then tp _L span {Pej}j e j c . 

In particular, the following are equivalent for a subset J C I: 

(1) We have 

span { ei } ieJ n P{U) + {0}, 

(2) We have 

span {Pejigjc ^ H. 

(3) The family {(I — P)ej}|j £ j is not £ 2 -independent. 

Remark 6.5. Note that the above corollary unifies the finite linearly independent result with 
the infinite one. i.e. The same theorem above holds with \I\ finite and linearly independent 
for part (3). 
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Remark 6.6. The above also raises the question if there is an infinite dimensional Rado- 
Horn Theorem. But we are not sure what it should say at this time. 

We note that property [D6] is an infinite dimensional version of a result from [?]. In 
this paper, using variations of the discrete Fourier transform matrices, the authors construct 
families of unit norm 2-tight frames for H n , so that whenever you partition the frame vectors 
into two subsets, the lower Riesz bound of one of the subsets is on the order of 1/n. For a 
counter-example to [D6], we are looking for unit norm 2-tight frames for £ 2 so that whenever 
you divide the frame vectors into two sets, one of them is not ^-independent. 

Finally, let us observe that we can find an equal norm Parseval frame with the above 
properties. This example is due to Bodmann, Casazza, Paulsen, and Speegle. 

Example 6.7. For any Ed [0, 1] measurable, the family 

can be written as k, ^-independent spanning sets for all k = 1, 2, . . . , oo. 

7. Some Notes 

It is possible that there is a better notion of redundancy than that given in [9]. The 
problem with that notion is that if we apply an invertible operator to a frame, we get 
different redundancy. Intuitively, this should not give a different value. A possible alternative 
definition is: 

Definition 7.1. Given a frame $ = {^p-i]f = i in l-i n with frame operator S, let or each i6§, 
the redundancy function 1Z<$, : § — > M + is defined by 

N 

^(x) = ^||P (5 _ 1/2( ^ )) (x)|| 2 . 
1=1 

Definition 7.2. Let $ = (<fi)iei be a frame for H. Then the upper redundancy of $ is 
defined by 

1Z\ = sup lZ$(x) 

and the lower redundancy of $ by 

= inf lZ$(x). 
Moreover, $ has a uniform redundancy, if 

This notion of redundancy equals the upper and lower frame bounds of the normalized 
version of the canonical Parseval frame to $. 

This definition seems to lose some of the properties of the original definition - which needs 
to be checked - such as 

[D4] Do these hold? Especially, if we add a Parseval frame to a frame, do these redundan- 
cies increase by 1? 
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[D5] Does 

^■ir- ,„ \n = c i scalars, 

Everything else seems to hold. But we do pick up a new result that redundancy is invariant 
under application of an invertible operator. 

Theorem 7.3. If $ = {tpi}f =l is a frame for T-L n and T is an invertible operator on % n , 
then for all x G % n we have 

Kt(<s>)( x ) = Kt(x), and TZ^(x) = K#(x). 
Proof. Let S (resp. St) be the frame operator for $ (resp. T($)). Then S ,_1 / 2 $ is equivalent 

— 1/2 

to $ which is equivalent to T($) which is equivalent to S 1 (T$). Since both of these frames 
are Parseval, it follows from [16] that there is a unitary operator U satisfying: 

u[(s- i/2 (®)} = ^r 1/2 (T$). 

The result is obvious from here. □ 

Alert: Unfortunately, this new idea for a definition does not work. We will now give an 
example to show that the upper frame bound of the normalized version of a Parseval frame 
is not related to the number of linearly independent sets we can partition the family into. 

Example 7.4. Fix N and let {ei}f =1 be an orthonormal basis for Hn- We will build a 
Parseval frame for Hn in pieces. First, we build the sets 

=ei H — 6j, t\ Cj for all i = 2, 3, . . . , N. 



V2N V2N V2N V2N 

This family is a frame for T-Ln with frame operator having eigenvectors {ei}f =1 and respective 
eigenvalues 

iV - 111 1 

N~ J ~N , ~N r " 'N' 
Hence, if we add to this family the vectors 

( I ^ N 

{-7=ei}U \ \ 



W 3 V N 

) i=2 

then we will have a Parseval frame which can clearly be devided into 3 linearly independent 
sets. Namely, divide the first set into 

N 



1 1 

-i=e\ + , e, 

/ 2iV V2N 



i=2 



and 

1 1 ^ 



i=2 



-.ex - 



'2N V2N 

and the third set is already linearly independent. However, if we normalize the vectors, we 
get a frame: 

1 1 ^ 

— ^=ei ± —=ei 
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plus {ei}fL 2 - For this family, if we check the frame bound at say e\ we get: 

V-l/ 1 1 M2 #-1 

E IK ^±^1 = — ■ 

That is, the upper frame bound of the normalized version of this Parseval frame is unrelated 
to the number of linearly independent sets we can divide it into. 

8. Concluding Remarks 

In the case of infinite redundancy, it is possible that our upper frame bound is infinity. It 
is not clear at this time if anything can be concluded from this case. 
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